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In this paper we study a problem of looking for an optimal solution of a system 
of the differential equations with a control and an optimized function. The system 
of differential equations is changed for two systems with the upper and lower ap- 
proximation functions of a function on the right side of the initial differential system 
and the lower approximation of the optimized function in a region of attainability. 
The necessary conditions of optimality are sufficient for the substituted system. 

A rule of an evaluation of an attainability set with the help of the positively 
definite functions is given in the second part of the paper. 
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1 Introduction 

Consider the following general problem of the control theory. Let us have a system 
of the differential equations 

x{t) = <p{x(t),u{t)), x(0) = x o , (1) 

and an optimized functional has a form 

(■T 

It — > inf, 



J(u)= [ f{x{r),u{r))di 
Jo 



u 



where x(t) £ M. n , u(t) takes values in U Cl r , where U is a convex compact set in 
W, t € [0,T]. We assume that the function /(•,•) is continuous and the function 
(/?(•,■) is Lipschitz in all arguments, so that the system (fTJ) satisfies the conditions of 
uniqueness for a solution passing through a point of the phase space. We consider 
the autonomous systems of the differential equations that does not restrict generality 
of consideration. 

We have to find an optimal control function u(-) that is a piecewise continu- 
ous differentiable vector-function from KC 1 [0, T] with values in U, defined on the 
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segment [0, T], for which the solution of the equation (pQ) gives the infimum of the 
functional </(•)• We replace the optimization problem ([2]) on the following problem 

J(u,t)= ! f(x(r),u(r))dT — > inf ue jrcir ,TUe[o,T]- (3) 
Jo 

We assume that the derivatives u'(-), where they exist, are uniformly bounded in 
the norm, i.e. 

II u'(t) ||< C Vt E N u [0,T], 

where K u [0, T] is a set of the points on [0, T], where derivatives of u(-) exist. In this 
case the pointwise convergence of a sequence {«&(•)} on [0, T] is equivalent to the 
uniform convergence of the functions on the set of continuity and, of course, 

is equivalent to the convergence in the metrics p of the space ETC 1 [0,T], which is 
equal, by definition, to the metrics of the space C[0, T], i.e. 

p(ui(t),u 2 (t)) d = max \\ui(t) - u 2 (t)\\. 

t€[0,T] 

Let us include into consideration all functions resulting from the pointwise limit. It 
is obvious that all the limit functions belong to a closed, bounded set of functions 
on [0,T], which we denote by KC [0,T]. The two functions from the set /CC 1 [0, T] 
are equivalent (equal), if these functions are equal on a set of full measure. 

We will solve the above formulated optimization problem ([3]) on the set /CC 1 [0, T], 

i.e. 

J(u,t) > ' m ^ u eKC 1 [0,T],t£[0,T]- ( 4 ) 

The problem is that an optimal control does not exist always. For this reason a 
generalized control (lower or upper semicontinuous) is considered. 

As an example, consider the following system of differential equations 

x(t) = u, sg(0) = 0, 

and optimized functional is defined as 

J(u)= I {{\-u 2 ) 2 +x 2 )dr ^ inf . 
Jo ue/cc^o.i] 

This problem does not have an optimal control u(-) in the set of piecewise contin- 
uously differentiable functions on [0,1], but has an optimizing sequence of controls 
{iifc(-)} in the form of the piecewise continuous functions with values ±1. It is easy 
to see that the optimizing sequence {xfe(-)}, corresponding to the sequence of con- 
trols {iifc(-)}> has a limit x = on [0, 1]. The control u(-) = 0, that corresponds to 
the solution x = 0, can not be received as a pointwise limit of {itfc(-)} and not an 
optimal control. 
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The right-hand side of the equation ([T]) can be very complex, and an exact solu- 
tion of this equation can often be found approximately using the numerical methods. 
The optimization of the function J(-) is also not easy if its form is complex. But 
optimization of the lower convex approximation of J(-) is simpler. Moreover, the 
global optimum point does not disappear when we take the lower convex approx- 
imation. In addition, the construction of the lower convex approximation of </(■), 
that we define by J(-), makes it weakly lower semicontinuous, i.e, 

lM Uk ^ U J( u k) > J{u) 

for any sequence {uk} converging to u weakly, which is an important requirement 
for the weak convergence of an optimization sequence to a solution of the problem 

We propose here a method of an equivalent substitution with help of which we can 
come over these difficulties. Namely, it is suggested a substitution of the right-hand 
side of the equation ([T]) to another function with a simpler structure. The search 
for the solutions of the differential equation (TjQ) (numerical or not) becomes simpler. 
The principle of an equivalent substitution declares that although we have another 
problem with simpler structure, but the function </(•) attains the same infimum on 
the set of piecewise continuous differentiable functions. At the same time a new 
optimized functional J(-) is getting lower semicontinuous. 

Taking into consideration the said above about the substitution of the functions 
(/?(•) and </(■), we can conclude that the search for an optimal control and an optimal 
trajectory becomes easier and the new optimal problem is equivalent to the old one in 
the sense of finding an optimal control. In this case the necessary optimal condition 
is also sufficient. 



2 The principle of equivalent replacement 



Let us consider, as above, the system of differential equations (P), and optimized 
functional @ . We rewrite the system (TjQ) and (UJ in the form of differential equations 

x(t) = (p(x(t),u(t)), 

m = /(*(<),«(*)) w 

with the initial conditions x(0) = x®, y(0) = 0. The minimization problem is 
replaced by the minimization problem 

y(t,u) > infue^c^o.TJ.te^T]- ( 6 ) 
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The solution of (|5|) is the solution of the integral equations 

x{t) = JIv{x{t),u(t))<It + XQ, 
' y(t) = J t f(x(r),u(r))dr, (7) 
k u{t) G KC l [Q,T) } t G [0,T], 

where u(-) is a piecewise continuous differentiable control. 

Let us unite all solutions of © in one set D(t) for t G [0, T] 

D(t) = {(x,y,z) | x = x(t) = / <p(x(t),u(t))<It + x , 

Jo 

V = y(t)= t f(x(r),u(r))dr,z = u(t) e/CC^T]}, (8) 



which is called the set of attainability of the systems ([I]) and Q at time t G [0, T]. 

It is easy to see that the optimization problem © is equivalent to the following 
optimization problem 

L(x, y,z)=y^ ™i y e)j W] D(t) ■ (9) 

The function L(x,y,z) = y is linear in the coordinates (x,y,z). (The function 
L(-,-,-) depends only on the coordinate y). It is known that any linear function 
reaches its maximum or minimum on the boundary of a compact set on which 
maximum or minimum is looking for. 

Since the set of the solutions of (pQ) according to the assumptions is bounded on 
[0,T], the set of the vector-functions u(-) is closed and bounded in K,C l \fi,T], then 
D{t) is closed and bounded for any t 6 [0,T] in the metric p of the space /CC 1 [0,T]. 
Indeed, if A u € U, then, as it was mentioned above, there is the uniform 
convergence of lifc(-) to n(-) on [0,T]\e, where e is a set with any small measure. 
Then there is convergence in measure The following convergence implies from 
the continuity of the functions (p(-, •), /(•,•) in all variables 

ip(x(r),u k (T)) ^ k (p(x{t),u(t)) Vt G [0,T], 

as well as 

f(x(r),u k (r)) -> fc /(x(r),n(r)) Vr G [0,T]. 

The uniform convergence of the integrals with respect to t G [0, T] and k implies 
from Egorov's theorem 0, i.e. 

t rt 

(p(x(r),u k (T))dT -»fc / (p(x(T,u(T))dr 
o JO 
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and 

/ f(x(r),u k (r))dT ->- fc / f(x(r), u(r))dr. 
Jo Jo 

Indeed, otherwise there exist sequences {T k } and {u k {-)}, for which and for some 

e > 0, the inequalities 

rtk rtk 
| / (p(x(T),u k (T))dr - / ip(x(T,u(T))dT |> £ 
Jo Jo 

and 

rtk rtk 
1/ f(x(r),u k (T))d,T - f(x(r),u(r))dT \> e. 
Jo Jo 

hold. The integrals can be considered as a function of t. It follows from Egorov's 

theorem that a set e exists with measure //(e) < £ for any small 5 > 0, that the 

integrals, as the functions of t, will converge uniformly in k over the set [0, T]\e. 

According to the absolute continuity, the integrals over the set e with measure 

/i(e) < 5 will be arbitrarily small if 5 is also arbitrarily small. As a result, we get a 

contradiction with the existence of e, for which the inequalities, written above, are 

true. 

Thus we have proved 

Theorem 2.1 The set D(t) is closed and bounded in AX^O, T] for any t £ [0,T] in 
the metric p of the space KC 1 [0,T]. 

We form a sequence of functions defined on [0, T], 

x k +i(t) = / <p(xk(r),Uk(r))dT. (10) 



The sequence {£&(■)} converges on [0, T] uniformly in k, if the sequence itfc(-) con- 
verges in the metric p to the function u(-) a.e. on [0, T]. Let us prove it. 

Indeed, we know from the said earlier that the functions itfc(-) converge to u(-) 
uniformly on [0, T\. We replace the control itfc(-) with the control u(-) in (jlOp . The 
difference between the original value of the integral (|10p and the new value of the 
same integral can be evaluated in the following way. According to the inequality 

| <p(x k (r),u k (T)) - V9(x fc (r),n(r)) |< L \ u k (r) - u(t) \ Vr € [0,T], 

where L is Lipschitz constant of the function </?(-, •) in the variables, the mentioned 
above difference is arbitrarily small for large k as well. Indeed, we have 

t f-t f-t 

<p(x k (r),u k (T)) - <p(x k (T),u(r)) \< L | u k (r) - u(r) \ Vt € [0,T\ 



o 



and the right side of this inequality is arbitrary small for large k. 
We use the following result. 
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Lemma 2.1 J3}/, ^j. The sequence {x^(-, u)}, k = 1,2,... converges uniformly for 
u £ U and k to the solution of £7p. 

Summing up all said above, we can conclude about the uniform convergence on 
[0,T] of the solutions of ([I]) for u = u k (-) to the solution x(-) of the same 

system with the control u(-) for k — » oo. 

Lemma 2.2 TTie sequence {x k (-)}, k = 1, 2, defined by \1U\) , converges uniformly 
on [0, T] m A; to i/ie solution cc(-) o/ (0). 

Remark 2.1 Lemma \2. Sty is also valid for the case when u k ^ u in the metric p\ 
of the space Li[Q,T], i.e. 

pi(u k ,u) = / | u k {r) - u(t) I dr. 
Jo 

The problem @ has a solution if the functional ([2]) is lower semicontinuous. It 
will be shown how to do it. 

If there is a solution of the problem Q on the set piecewise continuous differen- 
tiable functions A'C 1 [0, T], then we have solution of the problem 

L(x,y,z) = y — ► inf (11) 

yeco Ute[o,T]°(*) 

where co is a symbol of taking the convex hull. 

We introduce a set of attainability (or an attainability set) for the time T, which, 
by definition, is 

D T = coU tmT] D(t), (12) 
where co" means a closed convex hull. It is easy to see that for arbitrary 



(x k (t k ),y(t k ),u k (tk)) G D(t k ) 

(xk(tk),y{tk),Uk(tk)) {x(t),y(t),u(t)) 
t k e [0,T],ie [0,71, t k ^ k t, 
(x(t),y(t),u(t)) €D(t) 



such that 
and 

the inclusion 



will be true. Therefore, the closure in (|12j) can be removed and the definition of the 
set Dt can be given as following 



D T = co U ie[0)T] D(t). 
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Moreover, the problem ([9]) and (|lip are equivalent in the sense that if one of them 
has a solution, then the other one has a solution as well and these solutions are the 
same. In addition, since projections of the set D(t),t € [0,T] on the axis x,y are 
closed and bounded, and, hence, compact in the corresponding finite-dimensional 
spaces and D(-) is continuous in t as the set-valued mapping, then inf in (jlip can 
be replaced by min and the problem (jlip can be rewritten in the following way 

L(x,y,z)=y — > min . (13) 
y eD T 

But the problem (|13j) would be the same if we change the functions cp(-, •) and /(•) 
on their lower convex approximations constructed on the set of attainability for the 
time T. Indeed, we take two arbitrary points (xi(t),yi(t),ui) and (x2(t) , y2(t) , vq) , 
t £ [0, T] from set D(t). Consider a linear combination with the nonnegative 
coefficients a%, «2> a\ + «2 = 1- Then, the point {a\Xi{t) + o^a^i), a\y\{t) + 
«22/2(i)) a-iui + 02^2) will belong to the set co D(t), if we replace the functions (p(-, •) 
and /(•,•) with the following: 

ip(aixi(r) + o,2X2{t), a\U\ + a 2 u 2 ) = ai<p(xi(r), ui) + o.2<p(x2(t), u 2 ) 

and 

/(aixi(r) + a 2 x 2 (r), ai^i + 0:2^2) = «i) + "2/(^2(7-), u 2 ). 

But this construction, built for all points of the regions D(t),t G [0, T], just means 
that we are constructing the lower convex approximations of the functions <£>(■,•) 
and /(•, •) in the attainability set for the time T, i.e. in Dt- 

Denoted by «/(•,•) the new optimization function after replacement of the func- 
tion /(•, •) with /(•, •) in D T 

J(u,t)= ! f(x(r),u(r))dT. 
Jo 

It is clear that J(-, •) takes the same optimal value in the attainability set Dt, that 
the functional J(-, •) takes for the system ([1]). 
Replace the system ([1]) on the system 

x{t) = -<p(x(t),u(t)), x(0) = -x , (14) 

and the optimized functional with the functional 

J(u,t) = f f(-x(r),u(r))dT. (15) 
J 

It is easy to see that the minimum or the maximum of the functional «/(•, •) did not 
change . Hence, the problem ([1]), Q and (JH]), (fl~5|) are replaceable. So "convexifi- 
cation" of the function (p(-, ■), in contrast to the procedure of " convexification" of 
the function /(•,■) should be as following: 
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1. We construct the lower convex approximation of the function </?(•, •) in the 
variables (x,u) from the attainability set for the time T, i.e. Dt, which we 
denote by (p%{-, •); 

2. Construct the upper concave approximation of the function </>(•, •) (or, equiv- 
alently, we construct the lower convex approximation for the function — cp(-, •) 
and after that take minus of this function) in the variables (x, u) from the 
attainability set for the time T, i.e. Dt, which we denote by <p2(~, ■)', 

3. Let us replaced the system (H|, (jl|) by two systems of the equations: 

x(t) = <pi(x(t),u(t)), a?(0) = x , «(•) eKC^T] (16) 
with the optimization function J(u, t) and 

x(t) = (p 2 {x{t),u{t)), x(0) =x , u(-) £KC l [Q,T] (17) 
with the same optimization function J(u,t); 

4. Let us find among the solutions of (|16j) and (|17j) the one that gives the smallest 
value of the functional J(u,t) in Dt- 

We obtain the following result. 

Theorem 2.2 There are the solutions among the solutions of (|16p and (|17p such 
that deliver a minimum (maximum) in u(-) G KC l \fl,T\ and t G [0,T] for the func- 
tional t 

J(u,t)= [ f(x(r)Mr))dT, 
Jo 

that coincides with the infimum (supremum) of the functional J(u,t) (see fijty). In 
this case the necessary conditions for a minimum (maximum) are also sufficient 
conditions. 

Remark 2.2 The set D(t),t G [0,T] is not necessarily compact, although it projec- 
tion on the axis x,y are compact. That's why we were able to move to the problem 

L{x,y,z) = y — > mm, 

y£D T 

if the problem fP|) has a solution. The latter coincides with the formulation of 
Mazur's theorem. It asserts that in any weakly convergent sequence {tifc(-)} £ 
L p ([0,T]), Ufc(-) — > u(-) can be chosen for each k subsequence convex hull of which 
is almost everywhere on [0,T] for k — > oo converges to some u(-) G L p [0,T]. In our 
case, there exists a sequence {uk(-)} G KC [0, T], the convex hull of which will con- 
verge to an optimal control u(-) G K.C l [0,T}. The sequence of the solutions {xk{-)}, 
corresponding to the controls Uk(-), will converge to an optimal solution x(-), corre- 
sponding to the control u(-), provided that the solutions have been calculated for the 
problems with the modified right-hand side. 
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Consider a few examples. It is clear that an equivalent replacement of one system 
to another can be applied to the differential system without the control u. 
Example 1. Let us given a differential equation 



x(t) = <p(x(t)) 



' (X- l) 2 , if x > 
(X + l) 2 , if x < 

with initial condition x(0) = 0. The optimized functional is given by 

f(x(t)) = x 2 (t) — >■ min for t € (— oo, +oo), 
The general solution of differential equations for x > has the form 

which tends to 1 for t — > oo. The general solution of the differential equation for 
x < is given by 

x(t) = -^--l, 

which tends to —1 for t — > oo. In order to meet the initial condition we have to put 
c = 1. The projection of the attainability set -D(_oo +oc ) on OX axis is the interval 

(-!,+!)• 

It is clear that the function /(•) takes its minimum at x = 0. But the same solu- 
tion is obtained if instead of the function </?(•) to take its lower convex approximation, 
namely, the function 

'{X - l) 2 , if x > 1 
<p(x) = < 0, if -1 < x < 1 

> (X + l) 2 ,if x < -1. 

Example 2. The same example, but 



J(x,u) = / £ 2 (t))g?T, 
^0 



which we minimize for t G [0,1]. The solution has the form 

Here the replacement of the function tp(-) with the function ip(-) on the whole line is 
impossible, since the projection of the attainability set D\ on OX axis is the interval 
[0,1/2]. 

Example 3. Let us given the differential equation 

x(t) = x 2 
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with the initial condition x(0) = 1. The general solution has the form 

x(t) = — , 

KJ t + c 

a solution, satisfying the initial condition, is 

The optimized functional has the form 

J(x,u) = / (— x 2 {t))(It — >t inf 
Jo 

for t € [0,1]. 

It is easy to compute its optimal value 

J(x,u)= [ (-x 2 (t))cIt = [ {-x(r))dT = x(0) - x(l) = -oo. 
Jo Jo 

In this case, the projection of the attainability set D\ on OX axis is the set 
(—oo,0) U [l,+oo). It is easy to see that the lower convex approximation of the 
functional J(-) on Di, which we denote by «/(•), takes the same value. Similar is 
true for the functional 

/OO POO 
(—x 2 (t))cIt = / (— x(t))cIt = x(l) — x(+oo) = — oo. 

Example 4. Let us consider the following problem 

x(t) = xsin(l/x) + u, x(0) = 0. 
The optimized functional is 

POO 

J{u) = I | u(t) — x(t) I dr — )• inf u . 
Jo 

We will get the following system after construction of the lower and upper approxi- 
mations 

x(t) = x + u, x(0) = 

and 

x(t) = -x + u, x(0) = 0. 
The optimal solution exists among their solutions x(t) = u(t) = 0. 
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3 An evaluation of the attainability set 

Let us have a system of differential equations 

x(t) = <p(x,u), x g M. n , te [0,T], u(t) ePcr (18) 

with the initial condition x(0) = 0, where <£>(■, •) is Lipschitz in the variables x,u, U 
is a convex compact set in M. r . The problem is to estimate the attainability set. By 
definition, the area of attainability for the time T is the set 

D T = co U ie[0)T] D(t), 

where 

D(t) = {x G M n | x = x(t) = [ ip(x(t),u(t))cIt, u{t) G [/,«(•) G JCC^T]}. 

Jo 

The choice of the initial position and the initial time of zero is not loss of generality. 

Take an arbitrary positively definite function V(x) (see [5]), satisfying the con- 
dition 

T7T,i 1 1 re 1 1 2 < V(x) < m2||x|| 2 . 

Let be 

<f(x, u, t) = ipi(x, u, t) + (p%(x, u, t) 

and v(-) : [0,T] — > M n is a piecewise continuous vector-function. 
Consider the systems of differential equations 

x(t) = (pi(x, u) = Vl (x, u) + v(t), t e [0, T], (19) 

and 

x{t) = (p 2 (x, u) = <p 2 (x, u) - v(t). t G [0, T], (20) 

Denote by 

DW=co U t6[0 ,r| A(*),* = l,2, (21) 
the attainability sets for the systems (|19p . ()20p . where 

Di(t) = {x G R n | x = Xi(t) = [ if>i(x(T),u(r))dT, n(r) G U, 

Jo 

u(-) G KC l [0,T]},i = 1,2. (22) 

Let the estimates of the attainability sets for the time T be given respectively by 
the inequalities 

< V{x) < ci, < V(x) < c 2 . 
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We get an estimation for the attainability set of the system (|18p for the time T. We 
show that the attainability set Dt for this system satisfies the inclusion 

D T C Dj? + 

Indeed, by definition, the set Drj9 + D^' will consist of the points on the curves 
tangent to which is the sum of the tangents to the curves consisting of the points 
of the sets -Di(ti) and 1^2(^2) for all t\,tz € [0,T]. It is clear, that for some vector- 
function v(-) the resulting set will include Dt, which consists of the points on the 
curves tangent to which is the sum of the tangents to the curves consisting of the 
points of the sets D\(t) and D2(t) for all t S [0,T]. 
As a result, the following theorem is proved. 

Theorem 3.1 For the attainability set Dt of U8\) the inclusion 

D T C Dfi + D ( t\ 

is true, where Dy , i = 1,2, are given by [21\). IHj) . 
It follows from here the following lemma. 

Lemma 3.1 The function V(-) satisfies the inequality 

< V(x) < a + c 2 

in the attainability set Dt of the system H8\) . 

Now consider two systems of differential equations (|18p and (??) with zero initial 
conditions at time zero. Let it be known that, for all x, u the inequality 

0<fc 1 <||4^4ll<^ (23) 

is true. Let us also know the attainability set of the system (??) for the time 
T. The problem is to obtain some estimates of the attainability set of the system 

(USD- 

The arguments will be carried out as before, considering the trajectories of the 
systems (fTSj) and (??). 

Any vector in the set Dt for some t € [0, T] and u € /CC^O, T] is 

x = x(t) = / (p(x(T),u(T))dr. 







Consequently, 



\X(t)\\ = \\ f v(x(t),u(t))cIt\\< [ y(x(T),u(r))\\dT < 
Jo Jo 
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<k 2 I ||yii(x(r),«(r))||drCfc2Di(t). 
J o 

Since the previous inclusion holds for any t E [0, T], it follows that 

D T C U^ =Q h 2 D 1 (t) = k 2 Uj =0 Dx{t) C k 2 Wuf =0 D^t) = k 2 D^ ] . 
The theorem is proved. 

Theorem 3.2 For the systems U8\) and (11 ) with the attainability sets Dj- and 
Dj9 respectively, for which the inequality {23\) holds, the inclusion 

D T C k 2 D^ 

is true. 

From here we can easily obtain the following conclusion. 

Lemma 3.2 In the attainability set Dt of the system t!8\) the function V(-) satisfies 
the inequality 

< V(x) < jfead, 

where the constant c\ limits the top value of the function V(-) in the attainability 
set of the system (11 ). 



4 Conclusion 

The obtained results allow us to move from a local optimal problem to a global 
optimal problem. To implement this it is required to construct the lower convex 
approximation and the upper concave approximation of the function written on 
the right side of the system of differential equations. We also construct the lower 
convex approximation for the optimized function. All constructions are made in the 
attainability set for the time T. 

It is suggested a method for an estimation of the attainability set with help 
of the positively definite functions (Lyapunov functions). The proposed method is 
based on the decomposition of the function, stayed on the right side of the system 
of differential equations, into the components for which the attainability set or its 
estimates are already known. That makes difference from the paper [6j, where the 
linear systems are considered. 

The proposed transformation method of the systems is particularly useful when 
it is difficult to get a solution of differential equations in an explicit form, but only 
using approximate methods. In addition, the sufficient conditions of optimality holds 
for an optimal control obtained according to the proposed method. 
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